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Abstract. - We study effects of independent white noise on synchronization phenomena in 
ensembles of coupled limit cycle oscillators with different native frequencies. We consider a simple 
model where the ensemble consists of two inter-connected clusters with own native frequencies 
and mean-field couplings are introduced between intra- and inter-clusters. Taking advantage 
of nonlinear mean-field coupling concept together with the law of large numbers valid in the 
thermodynamic limit, we employ a nonlinear Fokker-Planck equation approach that turns out 
to be noise level-free analysis, to analytically derive the time evolution of the order parameters. 
Showing the occurrence of bifurcations from chaotic attractors in the deterministic limit to limit 
cycle ones with increasing noise intensity, we confirm the occurrence of nonequilibrium phase 
transitions including inter-cluster synchronization induced by external noise. 
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Introduction. — Synchronization phenomena are 
ilbiquitous ones observed in many fields of natural sci- 
ences [T]. In particular, synchronization phenomena of 
limit cycle oscillators with different native frequencies are 
of paramount importance in studies of nonlinear dynamic 
Systems and neurosciences. In neurosciences, neurons in 
the basal ganglia, which consists of several types of neu- 
tons with different firing frequencies [5] , exhibit more syn- 
chrony in Parkinson's disease than in normal state, sug- 
gesting that neural information coding associated with 
action selections of motor controls is closely related to 
the synchronization phenomena (Ref. [3] and references 
therein) . For such a reason, to study how the noise exerts 
its influence on the structure of synchronization will be of 
great importance from the viewpoint of nonlinear dynam- 
ical controls involving changes in synchrony of oscillatory 
systems. 

Relationships between effects of noise and synchroniza- 
tion phenomena have been studied using various types of 
models. It can be intuitively supposed that the presence 
of noise might deteriorate the degree of synchronization of 
oscillatory systems. Breakdown of coherence and synchro- 
nization due to external noise in an ensemble of limit cycle 
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oscillators has been reported [3]. In contrast, the opposite 
phenomena of noise-induced synchronization are becom- 
ing an active field of the study of nonlinear dynamical 
systems j5l413j. Synchronization phenomena induced by 
independent noise in coupled excitable systems (including 
active rotator models) have been investigated both ana- 
lytically [SJini and numerically [7]. A sparsely connected 
network of integrate-and-fire neurons with inhibitory cou- 
plings has been found to exhibit noise induced synchro- 
nization |8j . Among analytical studies on synchronization 
phenomena of ensembles of stochastic limit cycle oscilla- 
tors is the phase reduction analysis [5t413j. Such type of 
recent studies reveal the effects of common noise on syn- 
chronization of uncoupled oscillators |12| and uncoupled 
two populations of oscillators [T3]. These studies, how- 
ever, are restricted to the case with weak noise. As far 
as we know, there are very few papers that concern an- 
alytical studies of the relationships between noise effects 
and synchronization in the case of coupled general types 
of limit cycle oscillators. 

We address the issue of synchronization phenomena of 
coupled limit cycle oscillators, which is supposed to be 
subjected to independent noise. In stochastic systems of 
a finite number of coupled limit cycle oscillators with ex- 
ternal noise, each oscillator behaves randomly under the 



P-1 



K.Okumura, A. Ichiki and M. Shiino 



influence of noise. Tlie corresponding Fokker-Planck equa- 
tions involving all of the variables that describe the sys- 
tems of many body oscillators are linear, as one of the 
standard master equations for Markovian dynamics. In 
this case, the probability densities of the systems as their 
solutions, in general, exhibit ergodic property to settle into 
equilibrium {i.e. fixed point type) probability densities for 
sufficiently large times. This implies that the order param- 
eters do not oscillate. 

To consider the synchronization phenomena in systems 
of coupled stochastic oscillators by overcoming the prob- 
lem mentioned above, one may introduce the concept of 
taking the thermodynamic limit based on a mean-field 
model. Taking advantage of these issues, it is useful to 
employ the nonlinear Fokker-Planck equation (NFFE) ap- 
proach [I4l - [T7] . In general, probability densities of the 
limit cycle oscillator systems might be multimodal under 
the influence of weak external noise. In some cases, how- 
ever, Gaussian approximation has been shown to be useful 
to qualitatively understand phase transitions involving bi- 
furcations from non-oscillatory to oscillatory states with 
changes in noise intensity |18] . 

Another way to avoid the difficulty of dealing with mul- 
timodal probability densities is to restrict models to some 
extent. Assuming that each element in the system is es- 
sentially governed by the vector field with a quadratic po- 
tential except for nonlinear terms representing mean-field 
couplings with other elements, one can take advantage of 
using NFPEs to exactly derive the time evolution of the 
order parameters in the thermodynamic limit for systems 
of nonlinearly mean-field coupled oscillators. The NFPEs, 
which may exhibit bifurcations, have turned out to be use- 
ful for studying the occurrence of chaos-nonchaos phase 
transitions P"5^ETj . 

In this letter, we study the influence of external noise 
on synchronization in globally nonlinear coupled oscilla- 
tors with two native frequencies. We focus our attention 
on the inter-cluster synchronization phenomena. Using 
the NFPE of mean-field coupled oscillators, we derive the 
time evolution of the order parameters without any ap- 
proximations. Investigating so obtained ordinary differ- 
ential equations for the order parameters instead of a set 
of the Langevin equations, we confirm the occurrence of 
nonequilibrium phase transitions involving changes from 
synchronous to asynchronous states with changes in noise 
strength. Part of this work has been briefly reported in 
the conference proceedings [52]. 

Model and nonlinear Fokker-Planck equation ap- 
proach. — To study globally coupled limit cycle oscil- 
lators with different native frequencies, first let us con- 
sider basic limit cycle oscillator units. We define a ba- 
sic two dimensional oscillator of z'-^^z^^-' with the form 

dz^y^/dt = -a'-y'^z'-y^ + j(y)F(w)(6(«'^)z(^) + b'-y-y^z'-y'^), 

where a^'') , b'^^^'''^ , J^^^ = x, y) are constants and F^^^ (•) 
are functions specifying the nonlinearity that correspond 
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Fig. 1: The limit cycle attractors exhibited by the basic units. 
The limit cycles show "loops" under some parameter settings. 
By adjusting the detuning parameter 5'^'''\ we can change the 
native frequency and/or the number of loops of the limit cycle. 

to transfer functions in analog neural networks |23H26) . 
The oscillator can be of limit cycle if the functions are 
appropriately chosen. We here specify the nonlinear func- 
tions as F^>^\x) = sin a;. Conducting a linear stabil- 
ity analysis of fixed points, we verify the occurrence of 
Hopf bifurcations under certain conditions to bring about 
limit cycle attractors. We set the parameter values as fol- 
lows: a(^) = 0.5, a'^y^ = 1.0, 6^^'^) = 0.5, fe^^-y^ = 1.5, 
l^(y,x) ^ _i2.0, b^y^y^ = -1.0, J(^) = 18.0, j'-y'^ = 30.0. To 
describe limit cycle oscillators with different native fre- 
quencies, we introduce detuning parameter b'^^^ such that 
a^y^ = 1.0 -I- S'^y^ The limit cycle attractors appear for 
S^y'> 6 (-0.4485, 19.35) (Fig. H]). 

We then consider a system of coupled limit cycle oscil- 
lators consisting of two clusters. The oscillators are as- 
sumed to be coupled via nonlinear global interactions and 
subjected to independent additive and multiplicative ex- 
ternal noise. The model dynamics we are concerned with 
is described by a set of Langevin equations using the basic 
oscillator units mentioned above [TWl22j : 
for site i in cluster 1 (i = 1, ■ • • , iVi), 

, {x) Ni 

7 (x) (x) , t(^,x) T^(x) /j(x,x) (x) , j{x,1l) (v)\ 

= -a\ 'zli + 2^ 4 ^1 W ^li + ^1 ^li ) 
i=i 

+eY^Kl!--^Ft\bt-\il^+bt'y^zif)+^^^\t), (1) 

k=l 

J (y) ^1 

Q^it _ _Jy)Jy) I jC^^y) piy)(u{y,'-c) Jx) , u'^y^y) Jy)\ 

N2 

+eY.Kl!-y^F^y\biy'''^zif + biy-yhii^) + ^'i^\t), (2) 

k=l 

for site i in cluster 2 (i = 1, • • • , N2), 

££2j_ _ I \^ 7-(2,2;)p(a:)/,(a:,a;) (x) ,(a:,iy) (y),^ 

— "2 "T 2^ '^ij ^2 \"2 '^2j ' "2 ^2] ) 

J = l 

+eY^Kll-^Ft\b[-^'^z[lUb[-'yh[f)+V^^\t), (3) 



p-2 



Stochastic inter-cluster synchronization 



dt 
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where z^^^ = x,y){c 



The total number of dynamic variables of the system is 
, consequently reduced from 2(A^i + to 4 in the ther- 
rnodynamic limit. Thus one has a set of the Langevin 
equations as dzi''Vdt = -aL^^^i''^ + J^°''^'^Fi^^) + 



1,2) are the real valued- 



dynamical variables of the 2D-oscillators at site i of clus- 
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ter a under the natural boundary conditions, ai 
are constants and i^a''"* (•) are nonlinear coupling functions. 
The mean-field intra- and inter- cluster coupling strengths 
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(t) may include noise as 
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In cluster 1 and 2, we postulate the different constraint 
parameters as Oj'^^ = a^^'-l-j'^-', with d'^'^^ being essentially 
responsible for the difference of native frequencies between 
the oscillators in the two clusters. We here note that under 
the setting of Eqs. (O, the native frequency distribution 
corresponds to p{u}) = {S{uj — u;i(ai)) -|- S{uj — aj2(a2)))/2. 
The inter-cluster coupling strengths are controlled by e. 
This parameter may take any real constant value, without 
constraining to weak connections. The external noise 
vil\t), d^'^V), <:lk'''\t) are of the white Gaussian type. 



0, 



where not common but independent noise is considered 
and Tl^^iit), C\k'^\t) are also independent of 

each other. We note that in the absence of noise, Eqs. ([1]) 
- with A^i = A''2 = 1 describe the behavior of coupled 
limit cycle oscillators with two native frequencies, which 
can exhibit chaos due to the inter-cluster coupling. 

In the thermodynamic limit Na — >■ 00, coupling 
strengths of Eqs. ([S|) ensure the convergence of each mean- 
field coupling term that appears in the model equations 
(H)) - (U). This is attributed to the law of large numbers, 
giving rise to the validity of the self-averaging property. 
Hence the NFPE [T7] satisfied by the empirical proba- 
bility density P{t,z) {z^ = {z'f\ z'f\ z'f\ z\^^)) of the 
Langevin equations - can easily be written down 
in the limit Na — > 00 We note that the empiri- 

cal probability density can also be obtained for each clus- 
ter in our model setting by taking marginal distribution: 
Pa.{p,Za) = / dzs,P{t,z), where (zj = zi^-*)) and a 

denotes the counterpart of cluster a. Then, the mean-field 
coupling terms in Eqs. (HJ - (jH) are expressed in terms of 



dz, 



(6) 



eK^°''^^^ {F^^ ) + ri')^'{t), where the original noise 
transformed to effective white Gaussian noise 77'^^^ as 



Di^l ^ D^^^ + ) + e2(F>)'}). The coupled 

NFPEs for the empirical probability densities Pc((t, Zq,) 
corresponding to above the set of the effective Langevin 
equations read 



„(m).(m) 



d. 



,(m) 



Pa. (8) 
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A Gaussian probability density satisfies Eqs. 
as a special solution. Since the H theorem [19] 
sures that the probability density satisfying Eqs. 
converges to the Gaussian-form for sufficiently large 
times, we represent the Gaussian probability densities 
exp [- 



as Pcait, 

where 

Caij{t) = { 



(x) 



2* 



C-\t)s^] /(27rv/detC7„W), 



Ay) 



Z'Qc (Za )g) — (^Q , ), 

3qj)g and denotes expectation over Pq. 
Now that Eqs. ^ and ([7|) are described in terms of the 
first and second moments, one obtains a set of closed 
ordinary differential equations involving at most second 
moments. While Gaussian approximations ignore cumu- 
lants higher than the second [T8| , our expressions based on 
the Gaussian probability densities are exact in the sense 
that a random variable representing the state of an indi- 
vidual oscillator of the nonlinearly coupled system under- 
goes a quadratic potential, thus constituting the Ornstein- 
Uhlenbeck process. The time evolution of each moment is 
calculated from Eqs. ([8]) and we have 



dt 



d{u)i 



where 
2 



dt 

d{u^\Jf) 
dt 

{a,P,fi, v) 



(10) 



-2a(f)(u(r)-)c 



2D 



(m) 



(11) 



(l,l,a;,y) 
,2 



, (2,2,x,2/), 
Note that (u 



(1,2, a;, a;), 

,l,2,y,2/), (l,2,a;,y), (l,2,2/,x). Note that (,u^^\^^^)^^ 
(t — >■ 00), implying that the covariant components of Cq 
take zero in the stationary states. 

For observing qualitative as well as quantitative dynam- 
ical behaviors of the system, we proceed to solve numeri- 
cally the above set of equations. When the coupling func- 



tions are specified as F^^ [x) = sinx, then {F]^')q_ and 
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{Fa )g are calculated as 




Nonequilibrium phase transitions and stochastic 
inter-cluster synchronization. Now that the NFPE 
as the time evolution of our system has been reduced to a 
set of moment equations ((9|)- (fTT|) that constitute the order 
parameter equations, it will suffice to deal with them to 
investigate the behavior of the system. The order param- 
eter equations ©-(HH) together with Eqs. (HI]) and (US]) 
are nonlinear, yielding various types of bifurcations with 
changes in the parameters. 

For simplicity, we only treat the Langevin noise case, 
i.e., = = 0, and do not study inter-cluster chaotic 
synchronization in this paper [57|. From Eqs. (jlO[) . the 
variances turn out to be constant for sufficiently large 
times. Since we are concerned with investigating nonequi- 
librium stationary states, particularly the appearance and 
disappearance of the inter-cluster synchronization phe- 
nomena in the thermodynamic limit, we confine ourselves 
to the appearance of limit cycle attractors with changes 
in the noise intensity. To identify attractors of limit cycle 
type, we employ two criteria: (a) the numerically esti- 
mated largest Lyapunov exponent (LLE) of the attractor 
nearly equals zero and (b) all of the relevant order pa- 
rameters exhibit periodic motions with a common time 
period. Note that both of them exclude the case where 
the attractor is of torus type. 

Numerical calculations were performed with the fourth- 
order Runge-Kutta method under the setting of parameter 
values: a['''> = 0.5, aj^^ = 1.0, b'^^'""'' = 0.5, 6^""'"^ = 1.5, 
^{y,x) ^ _i2.0, = -1.0, J("'^^) A'("^^' = 18.0, 

j(Q,y) ^ j^{a,y) ^ gg^Q, 4"^^ = 0.5 + S'^'^K, = 

1.0 + S^^K Nonequilibrium phase transitions involving the 
intcr-cluster synchronization of the limit cycle oscillators 
are systematically investigated with changes in the inter- 
cluster coupling strength e and the detuning parameters 
(5*^^^ , and the Langevin noise intensity D^f^\ For simplic- 
ity, we take (5*^^^ = D^*'^ = in what follows. 

We begin with investigating behaviors of the system 
that exhibits a chaotic attractor in the deterministic limit 
(Fig. 12). The chaos originates from one pair system of 
different native frequencies. We note that "determinis- 
tic limit (D'^^) 0)" and "essentially deterministic case 
= 0)" may be different dynamics. Our model is 
proposed so that once external noise is introduced to the 
system, the model constrains the form of the probability 
densities to the Gaussian ones for sufficiently large times 
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Fig. 2: Dependence of the largest Lyapunov exponents (LLE) 
on the Langevin noise intensity D'"^', when _D'"' = tj'^' = 0. 
Since the basic oscillators show single loop limit cycles for 
^tf) = 4.5^ the system consists of coupled 6 and 1 loop limit 
cycles. In the deterministic limit, the LLE has a positive value, 
implying a chaotic attractor. For the noise intensity 7?'^' larger 
than a certain value, the LLE almost take zero, and the attrac- 
tor changes into that of limit cycle type via torus type (denoted 
by LC and T, respectively). 

due to mean-field coupling (self-organization). This indi- 
cates that all oscillators in each cluster show the same be- 
havior in the deterministic limit. Thus chaotic attractors 
in the deterministic limit imply intra-cluster synchronized 
chaotic behavior. 

The property of worth noting of inter-cluster synchro- 
nization originates from effects of noise (Fig. [5]). With 
increase of the Langevin noise intensity D'^^\ the chaotic 
attractors with positive LLEs in weak noise limit change 
into those of limit cycle type via torus type, suggesting 
the appearance of the inter-clustcr synchronization. Fur- 
ther increase of the noise intensity leads to negative values 
of the LLEs, implying fixed point type attractors. These 
results arc qualitatively consistent with those reported by 
Hakim and Rappel (Figs. 1 and 2 in Rcf. [21]), where a 
set of Langevin equations were solved numerically. 

Wc show below the dynamics of the order parameters 
in phase space. The changes of types of attractors ob- 
served in terms of the LLE in Fig. |2] can be more di- 
rectly seen in Figs. [3] and HJ where the corresponding 
changes of trajectories are drawn. It is seen that as the 
noise strength increases, the roughly estimated number 
of loops of chaotic trajectories decreases, while it gives 
rise to bifurcations from chaotic to torus type attractor. 
Eventually the attractor becomes that of limit cycle type, 
which corresponds to the occurrence of inter-cluster syn- 
chronization in the system. Within the context of rough 
argument, Fig. |4] (c) implies the occurrence of the so- 
called "in-phase" synchronization. Note that when the 
attractor is of torus type, the clusters are asynchronous 
because there are no common time period. Phenomena of 
noise induced chaos can be also reproduced (though not 
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Fig. 3: The behavior of the order parameters of the system in 
phase space. The left ((a), (c), (e)) and right ((b), (d), (f)) 
columns show the trajectories projected to the (zJ^')g-(zi^^)g 
and {z2^^)c-{z2^'')g planes, respectively, (a), (b) In the deter- 
ministic limit D'^^ = 0, it exhibits chaotic behavior, (c), (d) 
Certain levels of noise intensity {e.g. D^""^ = 0.0018) give rise 
to torus type attractors. (e), (f) For larger noise intensities 
{e.g. D'^' = 0.0022), limit cycle attractors appear, confirm- 
ing the occurrence of stochastic inter-cluster synchronization 
in macroscopic physical quantities. 



shown here), which are qualitatively in good agreement 
with those observed in Refs. P^[^ . 

We also show the effects of the frequency differences 
(essentially equivalent to the detuning parameter 5^^^) as 
well as the inter-cluster couping strength e on synchro- 
nization phenomena with and without noise (Fig. [S]) . For 
the weak inter-cluster coupling strengths (Fig. E] (a)), it 
is shown that certain levels of noise intensity can give rise 
to synchronized states in a broad region of s^y^ even if 
the clusters do not synchronize in the deterministic limit. 
In the case of the strong inter-cluster coupling strengths 
(Fig. [S](b)), it is seen that the quenched oscillatory states 
(oscillator death), which were first reported by Shiino and 
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Fig. 4: Other views in phase space, (a), (b) and (c) correspond 
to the attractors shown in Figs. [31(a) and [31(b), Figs. [31(c) 
and [31(d) and Figs. [31(e) and [31(f), respectively. It is clearly 
seen that the small or large mean value of (z'^')g follows that 
of (22^')g in the synchronized state, which roughly implies so- 
called in-phase synchronization. 

Frankowicz [21] , are observed for larger values of j'^^ in the 
deterministic limit. The increase of noise intensity induces 
breakdown of synchronized states. We note that complex 
behaviors can be observed in this model, depending on 
initial conditions (the results are not shown here). 

Summary. — We have shown the effects of indepen- 
dent Langevin noise on the behavior of synchronization 
of mean-field coupled limit cycle oscillators in the ther- 
modynamic limit. The ensemble is assumed to consist of 
two clusters of oscillators with different native frequen- 
cies. To investigate stochastic inter-cluster synchroniza- 
tion phenomena, we have used the NFPE approach. Since 
the NFPE for our model yields a Gaussian type prob- 
ability density as its solution for large times, the time 
evolution equations of the relevant order parameters of 
the system become to be analytically derived. It should 
be noted that the method turns out to be a noise level- 
free analysis. Solving the order parameter equations nu- 
merically, we have systematically investigated the occur- 
rence of nonequilibrium phase transitions with changes in 
the inter-cluster coupling strength e and the detuning pa- 
rameters (S''^' responsible for native frequency difference, 
and the Langevin noise intensity D^'^\ The results have 
shown various interesting bifurcation phenomena includ- 
ing the inter-cluster synchronization and chaotic attrac- 
tors induced by noise. To our knowledge, papers studying 
analytically systematic models of general types of limit cy- 
cles from our viewpoint and also available for comparisons 
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Fig. 5: Dependence of the largest Lyapunov exponents (LLE) 
on the detuning parameter d^'"\ when 7?'"' = 5'^^ = 0. (a) 
Weak inter-cluster coupling strength (e = 0.029). In the deter- 
ministic limit, the large values of 5^^-' induce chaotic behaviors. 
Under the appropriate noise intensity {e.g. D^^^ = 0.0040), the 
chaotic attractors are suppressed to settle into limit cycle at- 
tractors. (b) Relatively strong inter-cluster coupling strength 
(e — 1.013). In the deterministic limit, the coupled oscillators 
do not oscillate for large values of These phenomena of 

oscillator death become to be observed in a broader region of 
§(.y) fQj. increasing noise intensity {e.g. D^^' = 0.0040). In 
both figures, all the points where the LLE take nearly zero 
show limit cycle attractors. 



with our results are very few. 

Details of the relationship between the parameters in- 
volving the inter-cluster coupling strength e as well as the 
detuning parameters (5^''-' and the behaviors of the inter- 
cluster synchronization will be reported elsewhere. Fur- 
thermore, the effects of the multiplicative noise includ- 
ing synaptic noise on the inter-cluster synchronization to- 
gether with comparative discussions of the results of phase 
models will be also reported elsewhere. 
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